Renyi Thermostatistics and Self-Organization 



A.G.Bashkirov* 

Institute Dynamics of Geospheres, RAS, 
Leninskii prosp. 38 (bldg.l), 119334, Moscow, Russia 

Abstract 

Taking into account extremum of a Helmholtz free energy in the equilibrium state 
of a thermodynamic system the Renyi entropy is derived from the Bohzmann entropy 
by the same way as the Helmholtz free energy from the Hamiltonian. The application 
of maximum entropy principle to the Renyi entropy gives rise to the Renyi distribution. 
The q -dependent Renyi thermodynamic entropy is defined as the Renyi entropy for 
Renyi distribution. A temperature and free energy are got for a Renyi thermostatistics. 
Transfer from the Gibbs to Renyi thermostatistics is found to be a phase transition at 
zero value of an order parameter rj = 1 — q . It is shown that at least for a particu- 
lar case of the power-law Hamiltonian H = C^^x^ this entropy increases with ry . 
Therefore in the new entropic phase at r/ > the system tends to develop into the 
most ordered state at ry = rjmax = • The Renyi distribution at rjmax becomes 

a pure power-law distribution. 

KEY WORDS: entropy bath, Renyi entropy, maximum entropy principle, order pa- 
rameter, phase transition, self-organization. 

1 Introduction 

Numerous examples of power-law distributions (PLD) are well-known in different fields of 
science and human activity [Ij. Power laws are considered [2J as one of signatures of complex 
self-organizing systems. They are sometimes called Zipf-Pareto law or fractal distributions. 
We can mention here the Zipf-Pareto law in linguistics p], economy |3] and in the science 
of sciences [2], Gutenberg- Richter law in geophysics (E], PLD in critical phenomena [Z|, PLD 
of avalanche sizes in sandpile model for granulated media and fragment masses in the 
impact fragmentation P[Qj}j, etc. 

According to the well-known maximum entropy principle developed by Jaynes |n] for a 
Boltzmann-Gibbs statistics an equilibrium distribution of probabilities must provide maxi- 
mum of the Boltzmann information entropy Sb upon additional conditions of normalization 
XiiPi = 1 and a fixed average energy U = {H)p = J2i HiPi . 

Then, the Gibbs canonical distribution {pP"*} is determined from the extremum of the 
functional 

W WW 

Lcip) = Pi^^Pi - aoJ2 Pi - l3o J2 HiPi, (1) 

i i i 

where ao and Po = l/fc^To are Lagrange multipliers and Tq is the thermodynamic tem- 
perature. 

However, when investigating complex physical systems (for example, fractal and self- 
organizing structures, turbulence) and a variety of social and biological systems, it appears 
that the Gibbs distribution does not correspond to observable phenomena. In particular, it is 
not compatible with a power-law distribution that is typical [2] for such systems. Introducing 
of additional constraints on a sought distribution in the form of conditions of true average 
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values (X("^))p of some physical parameters of the system X^™) gives rise to a generalized 
Gibbs distribution with additional terms in the exponent but does not change its exponential 
form. 

Montroll and Shlesinger [12] investigated this problem and found that maximum entropy 
principle applied to the Gibbs-Shannon entropy could give rise to the power-law distribution 
under only very special constraint that "has not been considered as a natural one for use in 
auxiliary conditions." 

2 Helmholtz free energy and Renyi entropy 

The well-known Boltzmann formula defines a statistical entropy, as a logarithm of a number 
of states W attainable for the system 



Here and below the entropy is written as dimensionless value without the Boltzmann con- 
stant ks . Besides, we will use a natural logarithm instead of binary logarithm accepted in 
information theory. 

This definition is valid not only for physical systems but for much more wide class of 
social, biological, communication and other systems described with the use of statistical 
approach. The only but decisive restriction on the validity of this equation is the condition 
that all W states of the system have equal probabilities (such systems are described in 
statistical physics by a microcanonical ensemble). It means that probabilities Pi = pw = 
1/W (for all i = 1,2, ...,W ) that permits to rewrite the Boltzmann formula as = 
— \npw- When the probabilities Pi are not all equal we can introduce an ensemble of 
microcanonical subsystems in such a manner that all Wi states of the i -th subsystem have 
equal probabilities Pi and its Boltzmann entropy is SI = — Inpj . The simple averaging 
of the Boltzmann entropy SI leads to the Gibbs-Shannon entropy 



Just such derivation of S^^'' is used in some textbooks (see, e. g. [TT?! fTl]) 

This entropy is generally accepted in equilibrium and non-equilibrium statistical thermo- 
dynamics |15|I16| and communication theory but needs in modification for complex systems. 
To seek out a direction of modification of the Gibbs-Shannon entropy we consider first 
extremal properties of an equilibrium state in thermodynamics. 

A direct calculation of an average energy of a system gives the internal energy U , its 
extremum is characteristic of an equilibrium state of rest for a mechanical system, other 
than a thermodynamic system that can change heat with a heat bath of a fixed temperature 
To . An equilibrium state of the latter system is characterized by extremum of the Helmholtz 
free energy F . To derive it statistically from the Hamiltonian H = J2iHi without use of 
thermodynamics we can following Balescu ^\ introduce a moment-generating function 




(2) 
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where a is the arbitrary constant, and construct a cumulant-generating function 



(5) 



that becomes the Helmholtz free energy F when divided by a that is chosen as a = — I/ZcbTq 

Such a choice of the pre- factor 1/a ensures a hmiting passing of the Helmholtz free 
energy F into the internal energy U when a oo ( Tq ^ ) . 

Now we return to the problem of a generalized entropy for open complex systems. Ex- 
change by both energy and entropy (or information) with the environment is inherent in 
such systems (see e. g. the book p2| devoted to this subject). 

It is pertinent to introduce the noun of an entropy bath (or information bath). Coupling 
with the entropy bath can be regarded as a necessary condition for self-organization of a 
complex system. 

As a result of such coupling the system under consideration can not reach a state of ther- 
modynamic equilibrium that is characterized by maximum of the Gibbs-Shannon entropy, 
derived by the simple averaging of the Boltzmann entropy. It is necessary to look for any 
other function to characterize its steady state resulted from the coupling with the entropy 
bath. 

An effort may be made to find a "free entropy" of a sort by the same way that was used 
above for derivation of the Helmholtz free energy for a system coupled with a heat bath. 
The moment-generating function is introduced as 

$s(«) = Ee"^'''' (6) 

i 

Then the cumulant-generating function is 

vl/s(a)=ln<l>5(a) = lnEpr«. (7) 

i 

To obtain the desired generalization of the entropy we are to find an a -dependent numerical 
pre-factor which ensures a limiting pass of the new entropy into the Gibbs-Shannon entropy. 
Such the coefficient is 1/(1 + a) . Indeed, the new a -family of entropies 

Si») = Y^^^T.P^"■ (8) 

includes the Gibbs-Shannon entropy as a particular case when a — > — 1 . 

Thus, it has appeared that the desired "free entropy" coincides with the known Renyi 
entropy |18| . It is conventional to write it with the parameter q = —a in the form 

(P) = Y^^lnEP? (9) 
On the other hand, we can represent Eq. © as 

'^s{q) = T.P^^^'~''^'''' (10) 

i 

Then the Renyi entropy can be represented as a particular case of the Kolmogorov-Nagumo 
[inj ED] generalized averages 



{x)<p = (P~'[}2P^<Pi^^)j (11) 

if we put there the Kolmogorov-Nagumo function in the form (j){x) = exp{(l — q)x} , 
(f)~^(x) = Inx"'^/^^^'^^ and choose x,- = InS'i^'* . 



Renyi introduced his entropy just in such a manner. Renyi wanted to find the most 
general class of entropies which preserved the additivity for statistically independent sys- 
tems and was compatible with the Kolmogorov-Nagumo generalized average. By this way 
he found the exponential Kolmogorov-Nagumo function . Physically, such a choice of 
(j){x) on its own appears accidental until it is not pointed to the fact that the same expo- 
nential function of the Hamiltonian provides derivation of the free energy which is extremal 
in an equilibrium state of a thermodynamic system exchanging heat with a heat bath. This 
fact permits us to suppose that the Renyi entropy derived in the same manner should be ex- 
tremal at a steady state of a complex system which exchange entropy with its surroundings 
actively. 

Note that for linear = cx + d the Kolmogorov-Nagumo generalized average turns 
out to be the ordinary linear mean and hence the Gibbs-Shannon entropy follows as an 
average entropy in the usual sense. 

3 Axiomatical foundation of the Renyi entropy 

In view of the way of the Renyi entropy derivation we can suppose that it is maximal at a 
steady state of a complex system being in contact with the entropy bath. Such a supposing is 
justified by the Shore-Johnson theorem [21, 22, 22j. They considered a procedure of updating 
of a distribution function when a new information related to the system had appeared in a 
form of an additional constraint I . 

Shore and Johnson gave five "consistency axioms" for this updating operation [211 122]: 
1) Uniqueness: The result should be unique. 2) Invariance: The choice of coordinate system 
should not matter (for continuous probability densities). 3) System independence: It should 
not matter whether one accounts for independent information about independent systems 
separately in terms of different densities or in terms of a joint density. 4) Subset indepen- 
dence: It should not matter whether one treats disjoint subsets of system states in terms 
of separate conditional densities or in terms of the full density. 5) In the absence of new 
information, we should not change the prior. 

The following theorem is proven on the base of these axioms (here it is for the particular 
case of a homogeneous prior distribution Ui = 1/W (for all i j): 

Theorem An updating procedure satisfies the five consistency axioms above if and only if 

it is equivalent to the rule 

Maximize 

w 

i 

under the constraint I . 
or 

Maximize any monotonous function '^{Ur^{j>)) under the constraint I . 

The most evident choice of the monotonous function is ^{Ur,) = In f/,,(p) , that is the 
Renyi entropy S^^^ for q = l — rj . Such a choice of ^ ensures the limit S^^^ S^'^'' when 

q 1 and passage of 5*^^^ (for all q ) to S'^-* in the case of absence of new information 
when Pi = Ui = 1/W (for all i ). Both these properties should be considered as necessary 
conditions for a choice of "^{Uri) . In particular, the function "^TiUr,) = {U^ leading 
to the Tsallis entropy fails because it does not satisfy the second of these conditions. 

Thus, the Shore- Johnson theorem provide quite conclusive foundation of the Renyi en- 
tropy as itself and the maximum entropy principle for it and in doing so it justifies the 



above proposal that the Renyi entropy as the free entropy is maximal at a steady state of a 
complex system. 

In the light of this theorem the Khinchin's uniqueness theorem for the Gibbs- 
Shannon entropy should be reconsidered. Khinchin based on the next three axioms: 

(1) S{p) is a function of the probabilities pi only and has to take its maximum value for 
the uniform distribution of probabilities pi = 1/W : S{l/W, l/W) > S{p') , where p' is 
any other distribution. 

(2) The second axiom refers to a composition S of a master subsystem and subordinate 
subsystem S^^ for which probability of a composed state is 

Pij=QU\i)pl (12) 

where Q{j\i) is the conditional probability to find the subsystem in the state j if the 
master subsystem is in the state i . Then the axiom requires that 

S{p) = S{p') + Sip^p'') (13) 

where 

s{p'\p'') = T.plsm) (14) 

i 

is the conditional entropy and S{Q\i) is the partial conditional entropy of the subsystem 
E^^ when the subsystem is in the i -th state. 

(3) S(p) remains unchanged if the sample set is enlarged by a new, impossible event with 
zero probability: S{pi, pw) = S{pi, pw, 0) 

While proving his uniqueness theorem Khinchin enlarged the second axiom. He supposed 
that all U states of the composite system S were equally probable, that is, pij = l/U for 
all i and j ; whence he got 

S{p)=lnU (15) 

Besides, Khinchin supposed that U-^ states of the subsystem S^^ corresponding to each 
i -th state of the master subsystem T,^ are equally probable, as well. So, he took Q{j\i) = 
l/U-^ for i = 1,...,W and j e U-^ ; whence from Eqs. and {HI) he obtained U-^ = 
Upj and 

5(Q|z) = lnf//^ S{p'\p'') = \nU + Y.pi\npl (16) 

i 

Substituting Eqs. (fT5|) . (fT6|) into Eq. (fT3|) Khinchin got the Gibbs-Shannon entropy for the 
master subsystem S^'^^{p^) = — YlY Pi ^^Pf • 1^ should be noted that the last Khinchin's 
supposition of equal probabilities of states of the subsystem E-^^ is the most questionable 
and should be abandoned. Indeed, the probability distribution for E^^ coupled with the 
master subsystem should be rather canonical distribution than equally probable one. On 
the other hand, the abandonment of this supposition destroys all the proof of the Khinchin 
theorem. 

So, we are left with only the Shore-Johnson theorem where the Gibbs-Shannon entropy 
is no more than a particular case of the Renyi entropy. 

4 The Renyi thermostatistics 

The maximum entropy principle for the Renyi entropy S'^^'^ under additional constraints 
of fixed value U = {H)p = J2i HiPi , and normalization of p gives rise [2S1 12E] to the Renyi 



distribution function 



= ) = Z^M 1 - /5i_lAi7, (17) 



At g — i> 1 the distribution {pi } becomes the Gibbs canonical distribution in which the 
constant j3 = I/ZcbTq . 

Substituting the Renyi distribution (fTTjl into the Renyi entropy definition 0, we find 
the thermodynamic entropy in the Renyi thermostatistics as 

^r=^r(pf)=^^i^^r- (18) 

where the Boltzmann constant is introduced. 

When g — 1 this entropy passes into thermodynamic entropy in the Gibbs thermo- 
statistics 

w 

SiG) = = kBlnY^e-^^""^. (19) 

i 

On the other hand, the Gibbs thermostatistics is based on the Gibbs distribution for energy 
Hi but not fluctuations of energy AHi . So, the Renyi distribution (fT7|) should be repre- 
sented as a distribution for energy Hi , as well. Dividing both the expression in the brackets 
in Eq. (fT7|l and Zji by (1 — (1 — q)pU/qY^^'^~^^ we get the alternative equivalent form of 
the Renyi distribution 

p.* = z;' (i + ^1^'"') ' ' (20) 

The thermodynamic Renyi entropy can be represented in the alternative form, as well 



. ln(l + l^/?*f/) + kB In (21) 



1-q q 

A physical q -dependent temperature in the Renyi superstatistics should be defined in a 
standard manner as 



' (kB (3* 



[ dU ) [q l + '-fP*u) kB/3- 

It was shown [22] that jd = (3q at least for the power-law Hamiltonian, so the physical 
q -dependent temperature becomes Tq = qT^ where Tq is the temperature of a heat bath. 
According to Ref. |23, the fact that Tg < T (g < 1) says in favor of greater ordering of 
states with lower q . 

The Helmholtz free energy is defined in the Renyi thermostatistics as 

F(^) = -fcsT.lnZ,. (23) 



On the other hand, the thermodynamic definition of the free energy should be 

F = U-TgS^^l (24) 



It is not difficult to ensure that both definitions coinside in the limit g — 1 . For arbitrary 
q , their equivalence can be checked for the particular case of the power-law Hamiltonian. 
With the use of the relation (3U =1/k [33] we get F - F^^^ = CqTg where 

C, = l/(g/t) - ln[l - (1 - q)/{qt, + q - 1)]/(1 - q). (25) 

Such a difference can not provoke objections because of the free energy is determined in 
thermodynamics with an accuracy of an addent CiT + C2 . 



5 Entropic phase transition 

Thus, we have Gibbs and Renyi thermostatistics based on different microscopic entropy 
definitions. Each of them provides an adequate description of corresponding class of systems 
and we need in a rigorous formulation of conditions of transfer from one thermostatistics to 
another. 

Transfer from the Gibbs distribution describing a state of dynamic chaos ^\ to power- 
law Renyi distributions that are characteristic for ordered self-organized systems j2j cor- 
responds to an increase of an "order parameter" rj = 1 — q from zero at q = 1 up to 

f]max 1 qmin • 

In accordance to the Landau theory [2H1 of phase transitions an entropy derivative with 
respect to the order parameter undergoes a jump at a point of the phase transition. 

Here we deal with the transfer from the Gibbs thermostatistics to the Renyi thermo- 
statistics corresponding to non-zeroth values of the order parameter rj . Let us consider a 
variation of the entropy at this transition. 

Now it is not difficult to calculate the limiting value at r] ^ of the derivative of the 
entropy S^^^ with respect to r] . We get 

According to a fluctuation theory for the Gibbs equilibrium ensemble we have 
whence 

(d/\S\ 1^ 
lim -— = -Cy. 28 

ri^O\ df] J 2 ^ ^ 

where Cy is the heat capacity at a constant volume. 

Thus, the derivative of the entropy gain with respect to the order parameter exhibits 
the jump (equal to Cv/2 ) at r] = . This permits us to consider the transfer to the Renyi 
thermostatistics as a peculiar kind of a phase transition into a more organized state. We 
can give this transition the name entropic phase transition. 

As a result of the entropic phase transition the system passes into an ordered state with 
the order parameter 7^ . In contrast to the usual phase transition that takes place at 
the temperature of phase transition, conditions of the entropic phase transition are likely to 



Figure 1: The landscapes of the entropies S!^^^[p^^\r], k)] (left) and S^'^^[p''^\r], k)] (right) 
for the power-law Hamiltonian with the exponent k and rj < k/{1 + k) . 

be determined partially for each concrete system. For example, a threshold of emergence of 
turbulence (see [221) ordered structure is determined by a critical Reynolds number 

and an emergence of Benard cells is determined by a critical Rayleigh number (see [27]). 

Social, economical and biological systems are realized as a rule in ordered self-organized 
forms. This is the reason why power-law and closely related distributions are characteristic 
for them but not canonical Gibbs distribution. 

For the particular case of a power-law Hamiltonian Hi = Cxf problem of a value 
of the order parameter was discussed in Ref. [2^] where maximum maximorum of the 
thermodynamic Renyi entropy was found at g = g^m = 1/(1 + ? that is, at rj = rj^ax = 
«;/(! + k) . The Renyi distribution for such rj^ax becomes a pure power-law distribution 
that agrees with observable data for self-organized systems. 

The landscapes of this entropy S^^^[p^^\r], k)] is illustrated in Fig. 1 (left). The land- 
scape of the usual thermodynamic Gibbs entropy S^'^\p^{x\q, k)] for the same Renyi dis- 
tribution is illustrated in Fig. 1 (right). It is seen that in contrast to S^^^[p^^\r], k)] the 
Gibbs entropy S^^^[p^{x\q, k)] decreases with the gain of r] and attains its maximum at 
T] = , that is in the most disordered state when the Renyi distribution becomes the Gibbs 
canonical one. 

6 Conclusion 

It should be stressed that thermodynamic laws are irrelevant to microscopic interpretations 
of thermodynamic functions. On the other hand, according to the Boltzmann-Gibbs mi- 
croscopic interpretation of entropy, its gain is accompanied by evolution of a system to an 
homogeneous equilibrium state of thermal chaos. In contrast, the Renyi thermodynamic 
entropy increases as a system ordering (departure of the order parameter rj from zero) in- 
creases (see Fig. 1). So, it can be considered as a kind of potential that drives the system 
to self-organized state. 

Transfer from the usual Gibbs thermostatistics to the Renyi thermostatistics takes the 
form of a phase transition of ordering with the order parameter 7] . As soon as the system 
passes into this new phase state of the Renyi thermostatistics, a spontaneous development 
of self-organization to a more ordered state begins accompanied with gain of thermody- 
namic entropy. In doing so the well-known contradiction between observable spontaneous 
self-organization and the Second Law is eliminated when we use the Renyi entropy as a 



microscopic definition of the thermodynamic entropy instead of the Gibbs-Shannon one. 

Moreover, it may be supposed that biological evolution or development are governed by 
the extremal principle of the Renyi thermostatistics. 
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